![[Amazon FSx for NetApp ONTAP] SnapMirror転送中に転送リクエストをした場合の挙動を確認してみた](https://devio2023-media.developers.io/wp-content/uploads/2023/08/amazon-fsx-for-netapp-ontap.png)
[Amazon FSx for NetApp ONTAP] SnapMirror転送中に転送リクエストをした場合の挙動を確認してみた
次の転送開始までに転送が完了しなくてもなんとかなる
2024.02.05転送が完了していないのに新たに転送を開始しようとした場合の挙動が気になる
こんにちは、のんピ(@non____97)です。
皆さんはSnapMirrorの転送が完了していないのに新たに転送を開始しようとした場合の挙動が気になったことはありますか? 私はあります。
以下記事でSnapMirrorの最大同時転送数を確認しました。最大同時転送数は100で、それ以上の転送のリクエストはキューに入り、転送を待機します。
SnapMirror relationshipでステータスがTransferringの場合、再度そのSnapMirror relastionshipに対して転送をかけようとするとどうなるのでしょうか。同じくキューに溜まるのか、それともエラーとなってしまうのか気になります。
特に、転送間隔を5分や10分にしているSnapMirror relationshipにおいて、差分量が多いと次の転送開始のタイミングまでに転送が完了しない可能性が高いと考えます。「このような場面ではSnapMirror自体がエラーになる」という仕様だと困ります。
実際に試してみます。
いきなりまとめ
- SnapMirror転送中に転送をしようとしてもエラーとなる
- 手動で
snapmirror updateをした場合はキューに溜まらない - スケジュール実行の場合はキューに溜まるような挙動をする
- 手動で
- 失敗した転送は
snapmirror show-historyで確認可能 - SnapMirrorの転送中であることが原因でSnapMirrorの転送ができなかったことはEMSイベントで確認できない
手動差分転送の場合
EMSイベントカタログの確認
SnapMirrorの転送中であることが原因でSnapMirrorの転送ができなかった場合、EMSイベントにSnapMirrorの転送失敗イベントが出力される可能性があります。
事前にSnapMirror関連のEMSイベントカタログを確認しておきます。
::*> event catalog show -message-name snapmirror*
Message Severity SNMP Trap Type
-------------------------------- ---------------- -----------------
snapmirror.block.on.reconstruct NOTICE Severity-based
snapmirror.block.reconstructErr ERROR Severity-based
snapmirror.copy.FailedErr ERROR Severity-based
snapmirror.copy.baseLine.done INFORMATIONAL Severity-based
snapmirror.copy.completed INFORMATIONAL Severity-based
snapmirror.copy.pause.srcNoNewData
INFORMATIONAL Severity-based
snapmirror.copy.readyFinal INFORMATIONAL Severity-based
snapmirror.dst.OnlineCompres ERROR Severity-based
snapmirror.dst.OnlineErr ERROR Severity-based
snapmirror.dst.OnlineNotComp ERROR Severity-based
snapmirror.dst.abortOps ERROR Severity-based
snapmirror.dst.autoRestrictMsg NOTICE Severity-based
snapmirror.dst.cannotFind ERROR Severity-based
snapmirror.dst.chk.stats INFORMATIONAL Severity-based
snapmirror.dst.chkDegradedMirrorErr
ERROR Severity-based
snapmirror.dst.chkDone NOTICE Severity-based
snapmirror.dst.chkDoneErr ERROR Severity-based
snapmirror.dst.chkSnapInfo INFORMATIONAL Severity-based
snapmirror.dst.chkSyncErr ERROR Severity-based
snapmirror.dst.chkVersionErr ERROR Severity-based
snapmirror.dst.directoryOperationFailASCII
ERROR Severity-based
snapmirror.dst.directoryOperationFailIntl
ERROR Severity-based
snapmirror.dst.fixDone NOTICE Severity-based
snapmirror.dst.fixUsingPriorChk NOTICE Severity-based
snapmirror.dst.multipath.connErr ERROR Severity-based
snapmirror.dst.multipath.maxConnErr
NOTICE Severity-based
snapmirror.dst.noBuffers ERROR Severity-based
snapmirror.dst.noSnapshots ERROR Severity-based
snapmirror.dst.onlineFailed ERROR Severity-based
snapmirror.dst.requestDenied ERROR Severity-based
snapmirror.dst.restart.createErr ERROR Severity-based
snapmirror.dst.restart.failed NOTICE Severity-based
snapmirror.dst.restart.invalidChkpt
NOTICE Severity-based
snapmirror.dst.restart.invalidSnaps
ERROR Severity-based
snapmirror.dst.restart.noRootVol ERROR Severity-based
snapmirror.dst.restart.readErr ERROR Severity-based
snapmirror.dst.restart.writeErr ERROR Severity-based
snapmirror.dst.resync.info NOTICE Severity-based
snapmirror.dst.resync.noAction NOTICE Severity-based
snapmirror.dst.revertAggr NOTICE Severity-based
snapmirror.dst.revertErr ERROR Severity-based
Message Severity SNMP Trap Type
-------------------------------- ---------------- -----------------
snapmirror.dst.revertVol ERROR Severity-based
snapmirror.dst.reverting ERROR Severity-based
snapmirror.dst.snapCreateWarning NOTICE Severity-based
snapmirror.dst.snapDelErr ERROR Severity-based
snapmirror.dst.sync.chkErr ERROR Severity-based
snapmirror.dst.sync.mm.nvlog ERROR Severity-based
snapmirror.dst.sync.mm.proto ERROR Severity-based
snapmirror.dst.updateDelayed NOTICE Severity-based
snapmirror.resync.blkRclmtn ERROR Severity-based
snapmirror.retry.replay ERROR Severity-based
snapmirror.src.cannotFind ERROR Severity-based
snapmirror.src.chkDone NOTICE Severity-based
snapmirror.src.chkSnapInfo INFORMATIONAL Severity-based
snapmirror.src.connDropped ERROR Severity-based
snapmirror.src.diffSnap ERROR Severity-based
snapmirror.src.fixDone NOTICE Severity-based
snapmirror.src.inCutOver ERROR Severity-based
snapmirror.src.inopick.abort INFORMATIONAL Severity-based
snapmirror.src.markedCorrupt ALERT Severity-based
snapmirror.src.multipath.connErr ERROR Severity-based
snapmirror.src.noNewData NOTICE Severity-based
snapmirror.src.notLicensed NOTICE Severity-based
snapmirror.src.notOn NOTICE Severity-based
snapmirror.src.notReady ERROR Severity-based
snapmirror.src.offline ERROR Severity-based
snapmirror.src.phaseI NOTICE Severity-based
snapmirror.src.phaseII NOTICE Severity-based
snapmirror.src.requestDenied ERROR Severity-based
snapmirror.src.restart.chkptFailed
NOTICE Severity-based
snapmirror.src.restart.noSnap ERROR Severity-based
snapmirror.src.resync.snapNotFound
ERROR Severity-based
snapmirror.src.resync.toSelf ERROR Severity-based
snapmirror.src.revertPending NOTICE Severity-based
snapmirror.src.snapGotDeleted ERROR Severity-based
snapmirror.src.snapshotErr ERROR Severity-based
snapmirror.src.sockErr ERROR Severity-based
snapmirror.src.sockOk NOTICE Severity-based
snapmirror.src.sync.FvolSyncTooSmall
ERROR Severity-based
snapmirror.src.sync.compressedVol
ERROR Severity-based
snapmirror.src.sync.flexSameFilerOrHA
ERROR Severity-based
snapmirror.src.sync.license NOTICE Severity-based
snapmirror.src.sync.platform ERROR Severity-based
Message Severity SNMP Trap Type
-------------------------------- ---------------- -----------------
snapmirror.src.sync.rootFullSync ERROR Severity-based
snapmirror.src.sync.sanitization NOTICE Severity-based
snapmirror.src.sync.tradSameFilerOrHA
ERROR Severity-based
snapmirror.src.threadErr ERROR Severity-based
snapmirror.src.versionMismatch ERROR Severity-based
snapmirror.src.vfiler.migrating ERROR Severity-based
snapmirror.src.vfilerAccess ERROR Severity-based
ファイルの追加
Amazon FSx for NetApp ONTAP(以降FSxN)のボリュームにファイルを追加します。
デフォルトのボリュームの情報は以下の通りです。
::*> volume efficiency show -volume vol1 -fields state, policy, storage-efficiency-mode, inline-compression, inline-dedupe, compression, data-compaction, auto-adaptive-compression-savings, auto-adaptive-compression-existing-volume, using-auto-adaptive-compression vserver volume state policy compression inline-compression storage-efficiency-mode inline-dedupe data-compaction auto-adaptive-compression-savings using-auto-adaptive-compression auto-adaptive-compression-existing-volume ------- ------ -------- ------ ----------- ------------------ ----------------------- ------------- --------------- --------------------------------- ------------------------------- ----------------------------------------- svm vol1 Disabled auto false false efficient false false true false false ::*> volume show -volume vol1 -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent ------- ------ ----- --------- --------------- ------- ----- ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- ------------------------------------------- svm vol1 128GB 121.6GB 128GB 121.6GB 316KB 0% 0B 0% 0B 316KB 0% 316KB 0% - 316KB 0B 0%
2GiBのテストファイルを作成します。
$ sudo mount -t nfs svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 /mnt/fsxn/vol1 $ df -hT -t nfs4 Filesystem Type Size Used Avail Use% Mounted on svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 nfs4 122G 320K 122G 1% /mnt/fsxn/vol1 $ sudo dd if=/dev/urandom of=/mnt/fsxn/vol1/random_pattern_binary_block_2GiB bs=1M count=2048 2048+0 records in 2048+0 records out 2147483648 bytes (2.1 GB, 2.0 GiB) copied, 13.826 s, 155 MB/s $ df -hT -t nfs4 Filesystem Type Size Used Avail Use% Mounted on svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 nfs4 122G 2.1G 120G 2% /mnt/fsxn/vol1
書き込み後のボリュームの情報は以下のとおりです。
::*> volume show -volume vol1 -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent ------- ------ ----- --------- --------------- ------- ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- ------------------------------------------- svm vol1 128GB 119.6GB 128GB 121.6GB 2.01GB 1% 0B 0% 0B 2.01GB 2% 2.01GB 2% - 2.01GB 0B 0%
SnapMirrorのグローバルスロットリングを絞る
SnapMirrorのグローバルスロットリングで転送速度を4KiBに絞ります。あえて転送速度を抑えることで、転送中の再転送のリクエストを実行しやすいようにしています。
::*> options
FsxId039d82384caa533a5
replication.throttle.incoming.max_kbs
- -
replication.throttle.outgoing.max_kbs
- -
2 entries were displayed.
::*> options -option-name replication.throttle.incoming.max_kbs 4096
1 entry was modified.
::*> options
FsxId039d82384caa533a5
replication.throttle.incoming.max_kbs
4096 -
replication.throttle.outgoing.max_kbs
- -
2 entries were displayed.
SnapMirrorの初期転送
SnapMirrorの初期転送を行います。
::*> snapmirror protect -path-list svm:vol1 -destination-vserver svm -policy MirrorAllSnapshots -auto-initialize true -support-tiering true -tiering-policy none
[Job 44] Job is queued: snapmirror protect for list of source endpoints beginning with "svm:vol1".
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------- ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 2.21GB 2.08GB 2.21GB 2.10GB 15.54MB 0% 0B 0% 0B 264KB 0% 15.54MB 1% - 15.54MB - -
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------- ------------ -------------- ---------------------
svm:vol1 svm:vol1_dst Uninitialized Transferring 0B 02/03 22:43:31
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
168KB 0% 0%
転送が開始されました。
1GiBのテストファイルの追加とSnapshotの取得
差分を作成するため、1GiBのテストファイルを追加します。
$ sudo dd if=/dev/urandom of=/mnt/fsxn/vol1/random_pattern_binary_block_1GiB bs=1M count=1024 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.25651 s, 172 MB/s $ df -hT -t nfs4 Filesystem Type Size Used Avail Use% Mounted on svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 nfs4 122G 3.1G 119G 3% /mnt/fsxn/vol1
1GiB分の差分情報となるようにSnapshotも取得しておきます。
::*> snapshot create -vserver svm -volume vol1 -snapshot test.2024-02-03_2244 -snapmirror-label test
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 160KB 0% 0%
2 entries were displayed.
SnapMirrorの差分転送
SnapMirrorの初期転送中に、差分転送のリクエストを行います。
::*> snapmirror update -destination-path svm:vol1_dst Error: command failed: Another transfer is in progress. ::*> snapmirror update -destination-path svm:vol1_dst Error: command failed: Another transfer is in progress.
2回実行しましたが、いずれも失敗しました。
SnapMirrorの状態を確認します。
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------- ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 2.21GB 1.70GB 2.21GB 2.10GB 412.6MB 19% 0B 0% 36.19MB 384.6MB 17% 412.6MB 19% - 412.6MB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------- ------------ -------------- ---------------------
svm:vol1 svm:vol1_dst Uninitialized Transferring 366.5MB 02/03 22:45:02
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 160KB 0% 0%
2 entries were displayed.
現在も転送中です。
snapmirror show-historyでSnapMirrorの操作履歴を確認します。
::*> snapmirror show-history
Destination Source Start End
Path Path Operation Time Time Result
----------- ----------- --------- ----------- ----------- -------
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:06
2/3/2024 22:45:06
failure
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:05
2/3/2024 22:45:05
failure
svm:vol1_dst
svm:vol1 create 2/3/2024 22:43:31
2/3/2024 22:43:31
success
3 entries were displayed.
::*> snapmirror show-history -instance
Destination Path: svm:vol1_dst
Source Path: svm:vol1
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Relationship Group Type: none
Operation: manual-update
Operation ID: e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4
Start Time: 2/3/2024 22:45:06
End Time: 2/3/2024 22:45:06
Result: failure
Transfer Size: -
Additional Information: Another transfer is in progress.
Destination Path: svm:vol1_dst
Source Path: svm:vol1
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Relationship Group Type: none
Operation: manual-update
Operation ID: dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4
Start Time: 2/3/2024 22:45:05
End Time: 2/3/2024 22:45:05
Result: failure
Transfer Size: -
Additional Information: Another transfer is in progress.
Destination Path: svm:vol1_dst
Source Path: svm:vol1
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Relationship Group Type: none
Operation: create
Operation ID: a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4
Start Time: 2/3/2024 22:43:31
End Time: 2/3/2024 22:43:31
Result: success
Transfer Size: -
Additional Information: -
3 entries were displayed.
転送中であることが原因で失敗していることが分かります。
EMSイベントログも確認します。
::*> event log show -event snapmirror*
There are no entries matching your query.
::*> event log show
Time Node Severity Event
------------------- ---------------- ------------- ---------------------------
2/3/2024 22:43:30 FsxId039d82384caa533a5-01
NOTICE arw.volume.state: Anti-ransomware state was changed to "disabled" on volume "vol1_dst" (UUID: "a70eccb6-c2e5-11ee-9f45-b91e5d8eebf4") in Vserver "svm" (UUID: "58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4").
2/3/2024 22:06:53 FsxId039d82384caa533a5-01
NOTICE arw.volume.state: Anti-ransomware state was changed to "disabled" on volume "vol1" (UUID: "89367dc9-c2e0-11ee-9f45-b91e5d8eebf4") in Vserver "svm" (UUID: "58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4").
2/3/2024 22:06:35 FsxId039d82384caa533a5-01
NOTICE Nblade.graceEnd: NFS server grace state has ended for Vserver "svm", LIF ID "1030", LIF IP address "10.0.8.246".
2/3/2024 22:05:49 FsxId039d82384caa533a5-01
NOTICE Nblade.graceBegin: NFS server grace state has begun for Vserver "svm", LIF ID "1030", LIP IP address "10.0.8.246".
2/3/2024 22:05:48 FsxId039d82384caa533a5-01
NOTICE Nblade.recoveryBegin: NFS server lock recovery has begun for Vserver "svm", LIFID "1030", LIF IP address "10.0.8.246".
2/3/2024 22:05:45 FsxId039d82384caa533a5-01
INFORMATIONAL Nblade.nfsCredCacheFlushed: When the administrator modifies the "extended-groups-limit" option or "auth-sys-extended-groups" option using the "vserver nfs modify" command, the entire credential cache is flushed that holds credentials on connections that use mixed-mode security style volumes or RPCSEC_GSS authentication or extended groups over AUTH_SYS. This makes subsequent operations on such connections slower for a short while, until the credential cache is repopulated. The value of "auth-sys-extended-groups" option is 0 (1:enabled, 0:disabled). The value of "extended-groups-limit" option is 32.
2/3/2024 22:05:45 FsxId039d82384caa533a5-02
INFORMATIONAL Nblade.nfsCredCacheFlushed: When the administrator modifies the "extended-groups-limit" option or "auth-sys-extended-groups" option using the "vserver nfs modify" command, the entire credential cache is flushed that holds credentials on connections that use mixed-mode security style volumes or RPCSEC_GSS authentication or extended groups over AUTH_SYS. This makes subsequent operations on such connections slower for a short while, until the credential cache is repopulated. The value of "auth-sys-extended-groups" option is 0 (1:enabled, 0:disabled). The value of "extended-groups-limit" option is 32.
2/3/2024 22:05:33 FsxId039d82384caa533a5-02
NOTICE arw.vserver.state: Anti-ransomware was changed to "disabled" on Vserver "svm" (UUID: "58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4").
2/3/2024 22:03:40 FsxId039d82384caa533a5-01
NOTICE snaplock.sys.compclock.set: The compliance clock time of the system has been set to Sat Feb 3 22:03:40 UTC 2024. Reason: initialized by administrator.
2/3/2024 22:03:39 FsxId039d82384caa533a5-02
NOTICE snaplock.sys.compclock.set: The compliance clock time of the system has been set to Sat Feb 3 22:03:39 UTC 2024. Reason: initialized by administrator.
2/3/2024 22:03:38 FsxId039d82384caa533a5-01
NOTICE passwd.changed: passwd for user 'fsx-oncall' changed.
2/3/2024 22:01:42 FsxId039d82384caa533a5-01
NOTICE passwd.changed: passwd for user 'fsxadmin' changed.
2/3/2024 21:58:54 FsxId039d82384caa533a5-02
NOTICE scsiblade.online: This node has completed initialization of the SAN configuration cache. FCP and iSCSI traffic are enabled on this node.
2/3/2024 21:58:27 FsxId039d82384caa533a5-02
INFORMATIONAL secd.rpc.server.ready: SecD is ready to serve all RPCs.
2/3/2024 21:58:09 FsxId039d82384caa533a5-01
NOTICE scsiblade.online: This node has completed initialization of the SAN configuration cache. FCP and iSCSI traffic are enabled on this node.
2/3/2024 21:57:43 FsxId039d82384caa533a5-01
INFORMATIONAL secd.rpc.server.ready: SecD is ready to serve all RPCs.
2/3/2024 21:57:28 FsxId039d82384caa533a5-02
NOTICE passwd.changed: passwd for user 'admin' changed.
2/3/2024 21:57:26 FsxId039d82384caa533a5-01
NOTICE passwd.changed: passwd for user 'admin' changed.
2/3/2024 21:54:10 FsxId039d82384caa533a5-02
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-06.com.bsdctl:target0 (type: partner2, address: 198.19.9.244:65200).
2/3/2024 21:54:10 FsxId039d82384caa533a5-02
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-06.com.bsdctl:target0 (type: partner, address: 198.19.9.244:65200).
2/3/2024 21:54:09 FsxId039d82384caa533a5-01
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-05.local:mailbox.target.pVlfj (type: mailbox, address: 198.19.9.64).
2/3/2024 21:54:08 FsxId039d82384caa533a5-01
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-06.com.bsdctl:target0 (type: partner2, address: 198.19.8.59:65200).
2/3/2024 21:54:08 FsxId039d82384caa533a5-01
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-06.com.bsdctl:target0 (type: partner, address: 198.19.8.59:65200).
Time Node Severity Event
------------------- ---------------- ------------- ---------------------------
2/3/2024 21:54:08 FsxId039d82384caa533a5-01
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-06.com.bsdctl:target0 (type: local, address: 127.0.0.1:65199).
2/3/2024 21:54:07 FsxId039d82384caa533a5-02
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-05.local:mailbox.target.pVlfj (type: mailbox, address: 198.19.9.64).
2/3/2024 21:54:07 FsxId039d82384caa533a5-02
NOTICE iscsi.session.stateChanged: iSCSI session state is changed to Connected for the target iqn.2012-06.com.bsdctl:target0 (type: local, address: 127.0.0.1:65199).
26 entries were displayed.
SnapMirrorの転送リクエストに失敗したというイベントはありません。
そのまましばらく待ちます。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 22:52:16 +00:00
FsxId039d82384caa533a5-02 2/3/2024 22:52:16 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 2.50GB 357.4MB 2.50GB 2.38GB 2.03GB 85% 0B 0% 1.97GB 2.00GB 80% 2.03GB 85% - 2.03GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------- ---------- -------------- ---------------------
svm:vol1 svm:vol1_dst Uninitialized Finalizing 2.04GB 02/03 22:52:12
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 160KB 0% 0%
2 entries were displayed.
::*> snapmirror show-history
Destination Source Start End
Path Path Operation Time Time Result
----------- ----------- --------- ----------- ----------- -------
svm:vol1_dst
svm:vol1 initialize
1/1/1970 00:00:00
2/3/2024 22:52:20
success
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:06
2/3/2024 22:45:06
failure
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:05
2/3/2024 22:45:05
failure
svm:vol1_dst
svm:vol1 create 2/3/2024 22:43:31
2/3/2024 22:43:31
success
4 entries were displayed.
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 22:53:16 +00:00
FsxId039d82384caa533a5-02 2/3/2024 22:53:16 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 2.54GB 402.1MB 2.54GB 2.41GB 2.02GB 83% 0B 0% 2GB 2.02GB 80% 2.02GB 84% - 2.02GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------ ------ -------------- ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Idle - -
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 160KB 0% 0%
vol1_dst
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
148KB 0% 0%
3 entries were displayed.
::*> snapmirror show-history
Destination Source Start End
Path Path Operation Time Time Result
----------- ----------- --------- ----------- ----------- -------
svm:vol1_dst
svm:vol1 initialize
1/1/1970 00:00:00
2/3/2024 22:52:20
success
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:06
2/3/2024 22:45:06
failure
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:05
2/3/2024 22:45:05
failure
svm:vol1_dst
svm:vol1 create 2/3/2024 22:43:31
2/3/2024 22:43:31
success
4 entries were displayed.
::*> snapmirror show -instance
Source Path: svm:vol1
Source Cluster: -
Source Vserver: svm
Source Volume: vol1
Destination Path: svm:vol1_dst
Destination Cluster: -
Destination Vserver: svm
Destination Volume: vol1_dst
Relationship Type: XDP
Relationship Group Type: none
Managing Vserver: svm
SnapMirror Schedule: -
SnapMirror Policy Type: async-mirror
SnapMirror Policy: MirrorAllSnapshots
Tries Limit: -
Throttle (KB/sec): unlimited
Consistency Group Item Mappings: -
Current Transfer Throttle (KB/sec): -
Mirror State: Snapmirrored
Relationship Status: Idle
File Restore File Count: -
File Restore File List: -
Transfer Snapshot: -
Snapshot Progress: -
Total Progress: -
Network Compression Ratio: -
Snapshot Checkpoint: -
Newest Snapshot: snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
Newest Snapshot Timestamp: 02/03 22:43:31
Exported Snapshot: snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
Exported Snapshot Timestamp: 02/03 22:43:31
Healthy: true
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Source Vserver UUID: 58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4
Destination Vserver UUID: 58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4
Current Operation ID: -
Transfer Type: -
Transfer Error: -
Last Transfer Type: update
Last Transfer Error: -
Last Transfer Error Codes: -
Last Transfer Size: 0B
Last Transfer Network Compression Ratio: 1:1
Last Transfer Duration: 0:0:0
Last Transfer From: svm:vol1
Last Transfer End Timestamp: 02/03 22:52:20
Unhealthy Reason: -
Progress Last Updated: -
Relationship Capability: 8.2 and above
Lag Time: 0:10:26
Current Transfer Priority: -
SMTape Operation: -
Destination Volume Node Name: FsxId039d82384caa533a5-01
Identity Preserve Vserver DR: -
Number of Successful Updates: 1
Number of Failed Updates: 0
Number of Successful Resyncs: 0
Number of Failed Resyncs: 0
Number of Successful Breaks: 0
Number of Failed Breaks: 0
Total Transfer Bytes: 2195650024
Total Transfer Time in Seconds: 529
Source Volume MSIDs Preserved: -
OpMask: ffffffffffffffff
Is Auto Expand Enabled: -
Percent Complete for Current Status: -
転送が完了しました。SnapMirrorの転送先ボリュームの使用量から2GiBしか転送できていません。また、SnapMirror転送中に取得したSnapshotも転送先ボリュームに存在しません。加えて、いくら待てどもSnapMirrorの転送は開始されません。
以上のことから、SnapMirrorの転送中に手動でSnapMirrorの差分転送をリクエストしても、キューに溜まるような動作はしないことが分かります。
スケジューリングによる差分転送の場合
8GiBのファイルの作成
先ほどは手動の差分転送でしたが、スケジューリングによる差分転送の場合はどうでしょうか。試してみましょう。
まず、8GiBのファイルを作成します。
$ sudo dd if=/dev/urandom of=/mnt/fsxn/vol1/random_pattern_binary_block_8GiB bs=1M count=8192 8192+0 records in 8192+0 records out 8589934592 bytes (8.6 GB, 8.0 GiB) copied, 57.0184 s, 151 MB/s $ df -hT -t nfs4 Filesystem Type Size Used Avail Use% Mounted on svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 nfs4 122G 12G 111G 10% /mnt/fsxn/vol1
5分間隔でSnapMirrorの転送を行うようにスケジューリング
5分間隔でSnapMirrorの転送を行うようにスケジューリングします。
::*> snapmirror show -destination-path svm:vol1_dst -fields schedule source-path destination-path schedule ----------- ---------------- -------- svm:vol1 svm:vol1_dst - ::*> snapmirror modify -destination-path svm:vol1_dst -schedule 5min Operation succeeded: snapmirror modify for the relationship with destination "svm:vol1_dst". ::*> snapmirror show -destination-path svm:vol1_dst -fields schedule source-path destination-path schedule ----------- ---------------- -------- svm:vol1 svm:vol1_dst 5min
スケジューリングの設定をしても、すぐに転送は開始されません。
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress source-path destination-path state status total-progress progress-last-updated ----------- ---------------- ------------ ------ -------------- --------------------- svm:vol1 svm:vol1_dst Snapmirrored Idle - -
スケジューリングによる転送開始確認
スケジューリングによる転送が開始されることを確認します。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 23:00:11 +00:00
FsxId039d82384caa533a5-02 2/3/2024 23:00:11 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 2.54GB 362.7MB 2.54GB 2.41GB 2.06GB 85% 0B 0% 2GB 2.02GB 80% 2.06GB 85% - 2.06GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------ ------------ -------------- ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Transferring 37.66MB 02/03 23:00:11
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 196KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
156KB 0% 0%
vol1_dst
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
168KB 0% 0%
4 entries were displayed.
::*> snapmirror show-history
Destination Source Start End
Path Path Operation Time Time Result
----------- ----------- --------- ----------- ----------- -------
svm:vol1_dst
- modify 2/3/2024 22:56:22
2/3/2024 22:56:22
success
svm:vol1_dst
svm:vol1 initialize
1/1/1970 00:00:00
2/3/2024 22:52:20
success
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:06
2/3/2024 22:45:06
failure
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:05
2/3/2024 22:45:05
failure
svm:vol1_dst
svm:vol1 create 2/3/2024 22:43:31
2/3/2024 22:43:31
success
5 entries were displayed.
転送が開始されました。
4GiBと3GiBのファイル追加をしてSnapshotを取得
差分として、4GiBと3GiBのファイル追加をします。
まず、4GiBのファイルです。
$ sudo dd if=/dev/urandom of=/mnt/fsxn/vol1/random_pattern_binary_block_4GiB bs=1M count=4096 4096+0 records in 4096+0 records out 4294967296 bytes (4.3 GB, 4.0 GiB) copied, 28.33 s, 152 MB/s $ df -hT -t nfs4 Filesystem Type Size Used Avail Use% Mounted on svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 nfs4 122G 16G 107G 13% /mnt/fsxn/vol1
ファイル作成完了後、Snaphostを取得します。
::*> snapshot create -vserver svm -volume vol1 -snapshot test.2024-02-03_2302 -snapmirror-label test
同様に3GiBのファイルを作成して、Snapshotを取得します。
$ sudo dd if=/dev/urandom of=/mnt/fsxn/vol1/random_pattern_binary_block_3GiB bs=1M count=3072 3072+0 records in 3072+0 records out 3221225472 bytes (3.2 GB, 3.0 GiB) copied, 20.7451 s, 155 MB/s $ df -hT -t nfs4 Filesystem Type Size Used Avail Use% Mounted on svm-084e468031175d2a1.fs-039d82384caa533a5.fsx.us-east-1.amazonaws.com:/vol1 nfs4 122G 19G 104G 15% /mnt/fsxn/vol1
::*> snapshot create -vserver svm -volume vol1 -snapshot test.2024-02-03_2304 -snapmirror-label test
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 196KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
196KB 0% 0%
test.2024-02-03_2302 188KB 0% 0%
test.2024-02-03_2304 172KB 0% 0%
vol1_dst
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
236KB 0% 0%
6 entries were displayed.
スケジューリングによる差分転送が開始される時間まで待機
スケジューリングによる差分転送が開始される時間まで待機します。
差分転送開始13秒前の状態は以下のとおりです。1.02GBしか転送できていません。ただし、test.2024-02-03_2244と1GiBのファイルを作成した際のSnapshotの転送は完了しています。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 23:04:47 +00:00
FsxId039d82384caa533a5-02 2/3/2024 23:04:47 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 3.84GB 589.7MB 3.84GB 3.65GB 3.08GB 84% 0B 0% 3GB 3.07GB 80% 3.08GB 84% - 3.08GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------ ------------ -------------- ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Transferring 1.02GB 02/03 23:04:35
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 196KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
196KB 0% 0%
test.2024-02-03_2302 188KB 0% 0%
test.2024-02-03_2304 172KB 0% 0%
vol1_dst
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
1.03MB 0% 0%
test.2024-02-03_2244 212KB 0% 0%
7 entries were displayed.
差分転送を開始する時刻を過ぎました。現在の状態は以下のとおりです。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 23:06:02 +00:00
FsxId039d82384caa533a5-02 2/3/2024 23:06:02 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 4.19GB 628.3MB 4.19GB 3.98GB 3.37GB 84% 0B 0% 3GB 3.34GB 80% 3.37GB 85% - 3.37GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------ ------------ -------------- ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Transferring 1.32GB 02/03 23:05:51
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 196KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
196KB 0% 0%
test.2024-02-03_2302 188KB 0% 0%
test.2024-02-03_2304 172KB 0% 0%
vol1_dst
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
1.03MB 0% 0%
test.2024-02-03_2244 236KB 0% 0%
7 entries were displayed.
エラーは特に発生していません。
snapmirror show-historyを確認します。
::*> snapmirror show-history
Destination Source Start End
Path Path Operation Time Time Result
----------- ----------- --------- ----------- ----------- -------
svm:vol1_dst
svm:vol1 scheduled-update
2/3/2024 23:05:00
2/3/2024 23:05:01
failure
svm:vol1_dst
- modify 2/3/2024 22:56:22
2/3/2024 22:56:22
success
svm:vol1_dst
svm:vol1 initialize
1/1/1970 00:00:00
2/3/2024 22:52:20
success
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:06
2/3/2024 22:45:06
failure
svm:vol1_dst
svm:vol1 manual-update
2/3/2024 22:45:05
2/3/2024 22:45:05
failure
svm:vol1_dst
svm:vol1 create 2/3/2024 22:43:31
2/3/2024 22:43:31
success
6 entries were displayed.
::*> snapmirror show-history -operation-type scheduled-update -instance
Destination Path: svm:vol1_dst
Source Path: svm:vol1
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Relationship Group Type: none
Operation: scheduled-update
Operation ID: b1a0d4b3-a410-4140-8155-33834f864bfd
Start Time: 2/3/2024 23:05:00
End Time: 2/3/2024 23:05:01
Result: failure
Transfer Size: -
Additional Information: Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
::*> snapmirror show-history -fields destination-path, source-path, operation-id, operation-type, start-time, end-time, result, transfer-size, additional-info
destination-path operation-id source-path operation-type start-time end-time result transfer-size additional-info
---------------- ------------------------------------ ----------- ---------------- ----------------- ----------------- ------- ------------- ------------------------------------------------------------------------------------------------------------------------------------------
svm:vol1_dst b1a0d4b3-a410-4140-8155-33834f864bfd svm:vol1 scheduled-update 2/3/2024 23:05:00 2/3/2024 23:05:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst 733ada81-c2e7-11ee-9f45-b91e5d8eebf4 - modify 2/3/2024 22:56:22 2/3/2024 22:56:22 success - -
svm:vol1_dst 70cd82e1-8db6-4dbc-8aee-f88328e83aac svm:vol1 initialize 1/1/1970 00:00:00 2/3/2024 22:52:20 success 2.04GB -
svm:vol1_dst e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:06 2/3/2024 22:45:06 failure - Another transfer is in progress.
svm:vol1_dst dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:05 2/3/2024 22:45:05 failure - Another transfer is in progress.
svm:vol1_dst a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 create 2/3/2024 22:43:31 2/3/2024 22:43:31 success - -
6 entries were displayed.
scheduled-updateが失敗しています。エラーメッセージはScheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)と手動で差分転送しようとした際のエラーAnother transfer is in progress.と異なります。
このままさらに待機します。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 23:10:09 +00:00
FsxId039d82384caa533a5-02 2/3/2024 23:10:09 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 5.38GB 807.4MB 5.38GB 5.11GB 4.32GB 84% 0B 0% 3GB 4.30GB 80% 4.32GB 85% - 4.32GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress
source-path destination-path state status total-progress progress-last-updated
----------- ---------------- ------------ ------------ -------------- ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Transferring 2.29GB 02/03 23:09:57
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
200KB 0% 0%
test.2024-02-03_2244 196KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
196KB 0% 0%
test.2024-02-03_2302 188KB 0% 0%
test.2024-02-03_2304 172KB 0% 0%
vol1_dst
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_224331
1.03MB 0% 0%
test.2024-02-03_2244 364KB 0% 0%
7 entries were displayed.
::*> snapmirror show-history -fields destination-path, source-path, operation-id, operation-type, start-time, end-time, result, transfer-size, additional-info
destination-path operation-id source-path operation-type start-time end-time result transfer-size additional-info
---------------- ------------------------------------ ----------- ---------------- ----------------- ----------------- ------- ------------- ------------------------------------------------------------------------------------------------------------------------------------------
svm:vol1_dst d41104f7-c68f-4793-90f6-f7370052d63d svm:vol1 scheduled-update 2/3/2024 23:10:00 2/3/2024 23:10:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst b1a0d4b3-a410-4140-8155-33834f864bfd svm:vol1 scheduled-update 2/3/2024 23:05:00 2/3/2024 23:05:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst 733ada81-c2e7-11ee-9f45-b91e5d8eebf4 - modify 2/3/2024 22:56:22 2/3/2024 22:56:22 success - -
svm:vol1_dst 70cd82e1-8db6-4dbc-8aee-f88328e83aac svm:vol1 initialize 1/1/1970 00:00:00 2/3/2024 22:52:20 success 2.04GB -
svm:vol1_dst e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:06 2/3/2024 22:45:06 failure - Another transfer is in progress.
svm:vol1_dst dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:05 2/3/2024 22:45:05 failure - Another transfer is in progress.
svm:vol1_dst a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 create 2/3/2024 22:43:31 2/3/2024 22:43:31 success - -
7 entries were displayed.
::*> date show -fields date (cluster date show) node date ------------------------- ------------------------ FsxId039d82384caa533a5-01 2/3/2024 23:15:07 +00:00 FsxId039d82384caa533a5-02 2/3/2024 23:15:07 +00:00 2 entries were displayed. ::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent ------- -------- ------ --------- --------------- ------ ------ ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- ------------------------------------------- svm vol1_dst 6.85GB 1.02GB 6.85GB 6.50GB 5.48GB 84% 0B 0% 3GB 5.47GB 80% 5.48GB 84% - 5.48GB 0B 0% ::*> snapmirror show-history -fields destination-path, source-path, operation-id, operation-type, start-time, end-time, result, transfer-size, additional-info destination-path operation-id source-path operation-type start-time end-time result transfer-size additional-info ---------------- ------------------------------------ ----------- ---------------- ----------------- ----------------- ------- ------------- ------------------------------------------------------------------------------------------------------------------------------------------ svm:vol1_dst 9c1c5b80-6e55-4cef-87fe-c351b162977b svm:vol1 scheduled-update 2/3/2024 23:15:00 2/3/2024 23:15:02 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) svm:vol1_dst d41104f7-c68f-4793-90f6-f7370052d63d svm:vol1 scheduled-update 2/3/2024 23:10:00 2/3/2024 23:10:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) svm:vol1_dst b1a0d4b3-a410-4140-8155-33834f864bfd svm:vol1 scheduled-update 2/3/2024 23:05:00 2/3/2024 23:05:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) svm:vol1_dst 733ada81-c2e7-11ee-9f45-b91e5d8eebf4 - modify 2/3/2024 22:56:22 2/3/2024 22:56:22 success - - svm:vol1_dst 70cd82e1-8db6-4dbc-8aee-f88328e83aac svm:vol1 initialize 1/1/1970 00:00:00 2/3/2024 22:52:20 success 2.04GB - svm:vol1_dst e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:06 2/3/2024 22:45:06 failure - Another transfer is in progress. svm:vol1_dst dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:05 2/3/2024 22:45:05 failure - Another transfer is in progress. svm:vol1_dst a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 create 2/3/2024 22:43:31 2/3/2024 22:43:31 success - - 8 entries were displayed.
5分間隔でscheduled-updateに失敗していますね。
グローバルスロットリングによる帯域制限を解除
なかなか転送が完了しないのでグローバルスロットリングによる帯域制限を解除します。
::*> options -option-name replication.throttle.incoming.max_kbs unlimited
1 entry was modified.
::*> options
FsxId039d82384caa533a5
replication.throttle.incoming.max_kbs
unlimited -
replication.throttle.outgoing.max_kbs
- -
2 entries were displayed.
すると、一気に転送が進みました。
::*> date show -fields date (cluster date show) node date ------------------------- ------------------------ FsxId039d82384caa533a5-01 2/3/2024 23:15:50 +00:00 FsxId039d82384caa533a5-02 2/3/2024 23:15:50 +00:00 2 entries were displayed. ::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent ------- -------- ------- --------- --------------- ------- ------- ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- ------------------------------------------- svm vol1_dst 13.92GB 2.08GB 13.92GB 13.22GB 11.14GB 84% 0B 0% 6.19GB 10.97GB 79% 11.14GB 84% - 11.14GB 0B 0% ::*> snapmirror show-history -fields destination-path, source-path, operation-id, operation-type, start-time, end-time, result, transfer-size, additional-info destination-path operation-id source-path operation-type start-time end-time result transfer-size additional-info ---------------- ------------------------------------ ----------- ---------------- ----------------- ----------------- ------- ------------- ------------------------------------------------------------------------------------------------------------------------------------------ svm:vol1_dst 9c1c5b80-6e55-4cef-87fe-c351b162977b svm:vol1 scheduled-update 2/3/2024 23:15:00 2/3/2024 23:15:02 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) svm:vol1_dst d41104f7-c68f-4793-90f6-f7370052d63d svm:vol1 scheduled-update 2/3/2024 23:10:00 2/3/2024 23:10:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) svm:vol1_dst b1a0d4b3-a410-4140-8155-33834f864bfd svm:vol1 scheduled-update 2/3/2024 23:05:00 2/3/2024 23:05:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) svm:vol1_dst 733ada81-c2e7-11ee-9f45-b91e5d8eebf4 - modify 2/3/2024 22:56:22 2/3/2024 22:56:22 success - - svm:vol1_dst 70cd82e1-8db6-4dbc-8aee-f88328e83aac svm:vol1 initialize 1/1/1970 00:00:00 2/3/2024 22:52:20 success 2.04GB - svm:vol1_dst e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:06 2/3/2024 22:45:06 failure - Another transfer is in progress. svm:vol1_dst dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:05 2/3/2024 22:45:05 failure - Another transfer is in progress. svm:vol1_dst a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 create 2/3/2024 22:43:31 2/3/2024 22:43:31 success - - 8 entries were displayed.
さらに30秒後の状態は以下のとおりです。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 23:16:28 +00:00
FsxId039d82384caa533a5-02 2/3/2024 23:16:28 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------- --------- --------------- ------- ------- ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 18.83GB 2.73GB 18.83GB 17.89GB 15.17GB 84% 0B 0% 14.95GB 15.11GB 80% 15.17GB 85% - 15.17GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress, snapshot-progress, last-transfer-size, unhealthy-reason, last-transfer-duration
source-path destination-path state status snapshot-progress total-progress last-transfer-size last-transfer-duration unhealthy-reason progress-last-updated
----------- ---------------- ------------ ---------- ----------------- -------------- ------------------ ---------------------- ------------------------------------------------------------------------------------------------------------------------------------------ ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Finalizing 3.58GB 3.58GB 9.20GB 0:16:4 Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.) 02/03 23:16:22
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
test.2024-02-03_2244 196KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
196KB 0% 0%
test.2024-02-03_2302 188KB 0% 0%
test.2024-02-03_2304 176KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_231500
180KB 0% 0%
vol1_dst
test.2024-02-03_2244 972KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
1.25MB 0% 0%
7 entries were displayed.
::*> snapmirror show-history -fields destination-path, source-path, operation-id, operation-type, start-time, end-time, result, transfer-size, additional-info
destination-path operation-id source-path operation-type start-time end-time result transfer-size additional-info
---------------- ------------------------------------ ----------- ---------------- ----------------- ----------------- ------- ------------- ---------------
svm:vol1_dst 8bd1f60d-3987-4720-b2ae-cde452ed8fc4 svm:vol1 scheduled-update 2/3/2024 23:00:00 2/3/2024 23:16:06 success 9.20GB -
svm:vol1_dst 9c1c5b80-6e55-4cef-87fe-c351b162977b svm:vol1 scheduled-update 2/3/2024 23:15:00 2/3/2024 23:15:02 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst d41104f7-c68f-4793-90f6-f7370052d63d svm:vol1 scheduled-update 2/3/2024 23:10:00 2/3/2024 23:10:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst b1a0d4b3-a410-4140-8155-33834f864bfd svm:vol1 scheduled-update 2/3/2024 23:05:00 2/3/2024 23:05:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst 733ada81-c2e7-11ee-9f45-b91e5d8eebf4 - modify 2/3/2024 22:56:22 2/3/2024 22:56:22 success - -
svm:vol1_dst 70cd82e1-8db6-4dbc-8aee-f88328e83aac svm:vol1 initialize 1/1/1970 00:00:00 2/3/2024 22:52:20 success 2.04GB -
svm:vol1_dst e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:06 2/3/2024 22:45:06 failure - Another transfer is in progress.
svm:vol1_dst dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:05 2/3/2024 22:45:05 failure - Another transfer is in progress.
svm:vol1_dst a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 create 2/3/2024 22:43:31 2/3/2024 22:43:31 success - -
9 entries were displayed.
::*> snapmirror show -instance
Source Path: svm:vol1
Source Cluster: -
Source Vserver: svm
Source Volume: vol1
Destination Path: svm:vol1_dst
Destination Cluster: -
Destination Vserver: svm
Destination Volume: vol1_dst
Relationship Type: XDP
Relationship Group Type: none
Managing Vserver: svm
SnapMirror Schedule: 5min
SnapMirror Policy Type: async-mirror
SnapMirror Policy: MirrorAllSnapshots
Tries Limit: -
Throttle (KB/sec): unlimited
Consistency Group Item Mappings: -
Current Transfer Throttle (KB/sec): unlimited
Mirror State: Snapmirrored
Relationship Status: Transferring
File Restore File Count: -
File Restore File List: -
Transfer Snapshot: test.2024-02-03_2304
Snapshot Progress: 0B
Total Progress: 4.09GB
Network Compression Ratio: 1:1
Snapshot Checkpoint: 0B
Newest Snapshot: test.2024-02-03_2302
Newest Snapshot Timestamp: 02/03 23:02:43
Exported Snapshot: snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
Exported Snapshot Timestamp: 02/03 23:00:02
Healthy: false
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Source Vserver UUID: 58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4
Destination Vserver UUID: 58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4
Current Operation ID: c9e668ff-3da3-4214-9dbd-f87e9d1c18e7
Transfer Type: update
Transfer Error: -
Last Transfer Type: update
Last Transfer Error: -
Last Transfer Error Codes: -
Last Transfer Size: 9.20GB
Last Transfer Network Compression Ratio: 1:1
Last Transfer Duration: 0:16:4
Last Transfer From: svm:vol1
Last Transfer End Timestamp: 02/03 23:16:06
Unhealthy Reason: Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
Progress Last Updated: 02/03 23:16:38
Relationship Capability: 8.2 and above
Lag Time: 0:16:40
Current Transfer Priority: normal
SMTape Operation: -
Destination Volume Node Name: FsxId039d82384caa533a5-01
Identity Preserve Vserver DR: -
Number of Successful Updates: 2
Number of Failed Updates: 0
Number of Successful Resyncs: 0
Number of Failed Resyncs: 0
Number of Successful Breaks: 0
Number of Failed Breaks: 0
Total Transfer Bytes: 12076011264
Total Transfer Time in Seconds: 1493
Source Volume MSIDs Preserved: -
OpMask: ffffffffffffffff
Is Auto Expand Enabled: -
Percent Complete for Current Status: 100
オペレーションID8bd1f60d-3987-4720-b2ae-cde452ed8fc4を確認すると、9.2GBの転送が行われたようです。これは1GiBのファイル追加時のSnapshotと8GiBファイルの追加時のSnapshot分だと推測します。
さらに30秒後の状態は以下のとおりです。
::*> date show -fields date
(cluster date show)
node date
------------------------- ------------------------
FsxId039d82384caa533a5-01 2/3/2024 23:17:02 +00:00
FsxId039d82384caa533a5-02 2/3/2024 23:17:02 +00:00
2 entries were displayed.
::*> volume show -volume vol1_dst -fields available, filesystem-size, total, used, percent-used, performance-tier-inactive-user-data, performance-tier-inactive-user-data-percent, size, dedupe-space-saved, dedupe-space-saved-percent, dedupe-space-shared,logical-used, logical-used-percent,logical-used-by-afs, logical-available, physical-used, physical-used-percent
vserver volume size available filesystem-size total used percent-used dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared physical-used physical-used-percent logical-used logical-used-percent logical-available logical-used-by-afs performance-tier-inactive-user-data performance-tier-inactive-user-data-percent
------- -------- ------- --------- --------------- ------- ------- ------------ ------------------ -------------------------- ------------------- ------------- --------------------- ------------ -------------------- ----------------- ------------------- ----------------------------------- -------------------------------------------
svm vol1_dst 22.63GB 3.34GB 22.63GB 21.50GB 18.16GB 84% 0B 0% 18GB 18.16GB 80% 18.16GB 84% - 18.16GB 0B 0%
::*> snapmirror show -fields source-path, destination-path, state, status, progress-last-updated, total-progress, snapshot-progress, last-transfer-size, unhealthy-reason, last-transfer-duration
source-path destination-path state status snapshot-progress total-progress last-transfer-size last-transfer-duration unhealthy-reason progress-last-updated
----------- ---------------- ------------ ------ ----------------- -------------- ------------------ ---------------------- ---------------- ---------------------
svm:vol1 svm:vol1_dst Snapmirrored Idle - - 7.16GB 0:0:53 - -
::*> snapshot show -volume vol1*
---Blocks---
Vserver Volume Snapshot Size Total% Used%
-------- -------- ------------------------------------- -------- ------ -----
svm vol1
test.2024-02-03_2244 196KB 0% 0%
test.2024-02-03_2302 188KB 0% 0%
test.2024-02-03_2304 176KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_231500
184KB 0% 0%
vol1_dst
test.2024-02-03_2244 972KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_230000
1.89MB 0% 0%
test.2024-02-03_2302 528KB 0% 0%
test.2024-02-03_2304 356KB 0% 0%
snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_231500
140KB 0% 0%
9 entries were displayed.
::*> snapmirror show-history -fields destination-path, source-path, operation-id, operation-type, start-time, end-time, result, transfer-size, additional-info
destination-path operation-id source-path operation-type start-time end-time result transfer-size additional-info
---------------- ------------------------------------ ----------- ---------------- ----------------- ----------------- ------- ------------- ---------------
svm:vol1_dst c9e668ff-3da3-4214-9dbd-f87e9d1c18e7 svm:vol1 scheduled-update 2/3/2024 23:15:00 2/3/2024 23:16:59 success 7.16GB -
svm:vol1_dst 8bd1f60d-3987-4720-b2ae-cde452ed8fc4 svm:vol1 scheduled-update 2/3/2024 23:00:00 2/3/2024 23:16:06 success 9.20GB -
svm:vol1_dst 9c1c5b80-6e55-4cef-87fe-c351b162977b svm:vol1 scheduled-update 2/3/2024 23:15:00 2/3/2024 23:15:02 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst d41104f7-c68f-4793-90f6-f7370052d63d svm:vol1 scheduled-update 2/3/2024 23:10:00 2/3/2024 23:10:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst b1a0d4b3-a410-4140-8155-33834f864bfd svm:vol1 scheduled-update 2/3/2024 23:05:00 2/3/2024 23:05:01 failure - Scheduled update failed to start. (Scheduled update was delayed because another SnapMirror operation for the relationship is in progress.)
svm:vol1_dst 733ada81-c2e7-11ee-9f45-b91e5d8eebf4 - modify 2/3/2024 22:56:22 2/3/2024 22:56:22 success - -
svm:vol1_dst 70cd82e1-8db6-4dbc-8aee-f88328e83aac svm:vol1 initialize 1/1/1970 00:00:00 2/3/2024 22:52:20 success 2.04GB -
svm:vol1_dst e0afc6da-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:06 2/3/2024 22:45:06 failure - Another transfer is in progress.
svm:vol1_dst dfb62b6b-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 manual-update 2/3/2024 22:45:05 2/3/2024 22:45:05 failure - Another transfer is in progress.
svm:vol1_dst a7b93ac8-c2e5-11ee-9f45-b91e5d8eebf4 svm:vol1 create 2/3/2024 22:43:31 2/3/2024 22:43:31 success - -
10 entries were displayed.
::*> snapmirror show -instance
Source Path: svm:vol1
Source Cluster: -
Source Vserver: svm
Source Volume: vol1
Destination Path: svm:vol1_dst
Destination Cluster: -
Destination Vserver: svm
Destination Volume: vol1_dst
Relationship Type: XDP
Relationship Group Type: none
Managing Vserver: svm
SnapMirror Schedule: 5min
SnapMirror Policy Type: async-mirror
SnapMirror Policy: MirrorAllSnapshots
Tries Limit: -
Throttle (KB/sec): unlimited
Consistency Group Item Mappings: -
Current Transfer Throttle (KB/sec): -
Mirror State: Snapmirrored
Relationship Status: Idle
File Restore File Count: -
File Restore File List: -
Transfer Snapshot: -
Snapshot Progress: -
Total Progress: -
Network Compression Ratio: -
Snapshot Checkpoint: -
Newest Snapshot: snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_231500
Newest Snapshot Timestamp: 02/03 23:16:06
Exported Snapshot: snapmirror.58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4_2148029383.2024-02-03_231500
Exported Snapshot Timestamp: 02/03 23:16:06
Healthy: true
Relationship ID: a7b93b32-c2e5-11ee-9f45-b91e5d8eebf4
Source Vserver UUID: 58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4
Destination Vserver UUID: 58ce93b4-c2e0-11ee-9f45-b91e5d8eebf4
Current Operation ID: -
Transfer Type: -
Transfer Error: -
Last Transfer Type: update
Last Transfer Error: -
Last Transfer Error Codes: -
Last Transfer Size: 7.16GB
Last Transfer Network Compression Ratio: 1:1
Last Transfer Duration: 0:0:53
Last Transfer From: svm:vol1
Last Transfer End Timestamp: 02/03 23:16:59
Unhealthy Reason: -
Progress Last Updated: -
Relationship Capability: 8.2 and above
Lag Time: 0:2:10
Current Transfer Priority: -
SMTape Operation: -
Destination Volume Node Name: FsxId039d82384caa533a5-01
Identity Preserve Vserver DR: -
Number of Successful Updates: 3
Number of Failed Updates: 0
Number of Successful Resyncs: 0
Number of Failed Resyncs: 0
Number of Successful Breaks: 0
Number of Failed Breaks: 0
Total Transfer Bytes: 19760744080
Total Transfer Time in Seconds: 1546
Source Volume MSIDs Preserved: -
OpMask: ffffffffffffffff
Is Auto Expand Enabled: -
Percent Complete for Current Status: -
転送が完了していそうです。
オペレーションIDc9e668ff-3da3-4214-9dbd-f87e9d1c18e7を確認すると、転送サイズは7.16GBでした。4GiBと3GiBのファイルと推測します。
現在の時刻は23:17:02です。そして、オペレーションIDc9e668ff-3da3-4214-9dbd-f87e9d1c18e7の開始時刻は23:15:00です。9.2GB転送をしたオペレーションID8bd1f60d-3987-4720-b2ae-cde452ed8fc4の終了時刻は23:16:06です。
23:15:0の段階では、まだ転送先ボリュームの使用量は5.48GBで、9.2GB分の転送が完了しません。そのため、c9e668ff-3da3-4214-9dbd-f87e9d1c18e7の開始時刻は23:15:00となっていますが、実際には先の転送が完了した23:16:06と考えます。そして、実際に転送を開始しているのが次回の実行タイミングである23:20:00よりも前です。そのため、キューに入っていたような動きをしていることが分かります。
次の転送開始までに転送が完了しなくてもなんとかなる
SnapMirror転送中に転送リクエストをした場合の挙動を確認してみました。
SnapMirrorのスケジューリングをしている場合、次の転送開始までに転送が完了しなくとも、転送が完了したタイミングで次の転送を開始してくれることが分かりました。転送間隔が短く、あまりにも転送間隔間の差分が多い場合は気をつけた方が良いと思いますが、短時間のスパイクであれば捌いてくれそうです。
この記事が誰かの助けになれば幸いです。
以上、AWS事業本部 コンサルティング部の のんピ(@non____97)でした!
